docs(langsmith): add filter-traces page for the rebuilt tracing filter UI - #5793
Draft
Florence Morris (fjmorris) wants to merge 9 commits into
Draft
docs(langsmith): add filter-traces page for the rebuilt tracing filter UI#5793Florence Morris (fjmorris) wants to merge 9 commits into
Florence Morris (fjmorris) wants to merge 9 commits into
Conversation
…r UI The tracing project filter experience has been rebuilt (DOC-1570), so filter-traces-in-application no longer describes how filtering works. Add a replacement page written against the shipped behavior. Navigation is unchanged; the nav swap, redirect, and link updates are follow-ups. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
lc-arjun
reviewed
Aug 31, 2026
lc-arjun
left a comment
Contributor
There was a problem hiding this comment.
leaving some comments, this looks really great though!
…S limits Addresses lc-arjun's review on #5793 and his answers on DOC-1570. - Field and operator corrections: `inputs`/`outputs` renamed to `input`/`output`, unbounded range dropped, `attachments` limited to exists and does not exist, Threads and Traces now default to `any run` - Document that an `any run` filter carries into the trace's tree view, and trim the legacy saved-view specifics, which are being replaced by automatic translation into the new syntax - Add a full-text search indexing section with the SmithDB limits, replacing the ClickHouse-era numbers the first draft omitted for lack of a source - Add a shared routing note, imported by both filter pages, that disambiguates on visible UI rather than on backend, since users are not expected to know which backend their instance runs Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Florence Morris (fjmorris)
left a comment
Contributor
Author
There was a problem hiding this comment.
update already committed.
…dexing Follow-up to lc-arjun's answers on DOC-1570, plus one correction of my own. - Fix the `attachments` row: it accepts is, is not, wildcard, and exists, not exists only. The review comment was hedged and the schema contradicts it, so the claim and its operator-constraints bullet are both removed - Separate full-text search from key-path filtering: metadata is indexed separately and is not subject to the token limits, and key-path filtering has no published limits of its own - Legacy views are auto-translated to the new syntax on selection, with a prompt to re-save - Details view: filtering highlights matches in place rather than narrowing the list, and the Most relevant and Show All options are disabled while a filter is applied Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Florence Morris (fjmorris)
left a comment
Contributor
Author
There was a problem hiding this comment.
commited updates
Applies a five-persona documentation review. - Restructure: scopes now follow Build a query, indexing limits move to the end as reference, and Examples and Troubleshoot a query sections are added - Accuracy: drop three unverified claims. "Millions of runs" and "hundreds" of runs per trace had no source, and a What next section implied filters carry into charts, evaluators, and rules, which the PRD rules out - Restore the `key` feedback subfield the review removed as unexplained. The autocomplete offers it first in both scopes, so omitting it put the page at odds with the product - Smaller edits: collapse padded table rows, define stopwords inline, bridge shortcut group labels to field names, scope-qualify two absolute statements Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Adds five light/dark pairs: the search bar, the scope selector with its sample-trace preview, two filter rows on different scopes, the Shortcuts panel, and match highlighting inside an open trace. Two wording fixes the screenshots forced: - The clear control in the trace filter box is an unlabelled icon, so the page no longer tells readers to click "Clear run filter", which is its accessible name rather than visible text - The scope preview sentence now introduces its image instead of describing a visual the reader could not see Named the in-trace image filter-trace-highlighting rather than filter-runs-in-trace to avoid confusion with the existing filter-runs-in-trace-view.png. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Replaces both Shortcuts screenshots with captures that have a shortcut applied: the error value checked, the Status header reading "1 active", and the resulting status:error clause in the search bar. The previous captures showed an idle panel beside an unrelated total_cost clause, so they supported neither claim the section makes. Alt text updated to match, including the wider crop that now reaches the Tag group. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Contributor
|
Mintlify preview branch generated: Site preview: https://langchain-5e9cc07a-preview-fjmorr-1788320705-f203809.mintlify.site Important Preview links may take a few minutes to start working while the deployment finishes. Changed documentation pages (preview deep links): |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
The LangSmith tracing filter UI has been rebuilt (Milestone 1 of the filter revamp, targeting rollout Sept 10). The chip-and-dropdown filter builder is replaced by a single search bar with a query language, the trace/tree filters are replaced by a scope selector, and the Filter Shortcuts pane has moved from the bottom of the right sidebar to a collapsible panel on the left.
filter-traces-in-applicationdescribes none of this, so it needs a full rewrite rather than edits.Linear: DOC-1570
What this PR does
Adds
src/langsmith/filter-traces.mdx. It documents:field:valueclauses, negation with-, full-text~, wildcards, existence, numeric comparisons, and rangesAND/OR/NOTprecedence, implicitANDon whitespace, and value quotinginput/output/metadataJSON keys and feedback subfieldsAlso adds
src/snippets/langsmith/filtering-experience-note.mdx, imported by both this page and the ClickHouse page, which routes readers between the two experiences.Includes five light/dark screenshot pairs: the search bar, the scope selector with its sample-trace preview, two filter rows on different scopes, the Shortcuts panel, and match highlighting inside an open trace.
SDK and API changes are out of scope for the initial release, so the page points at
trace-query-syntaxfor the structured query language.A five-persona documentation review was applied on top of the first draft. It moved scopes ahead of the syntax reference, moved the indexing limits to the end, added Examples and Troubleshoot a query sections, and removed three unsourced claims.
make lint_proseandmake broken-linksboth pass.How the details were verified
The field tables, scope labels, per-view defaults, and operator support come from the
smithdb-filter-langWASM schema and theFiltersRevampcomponents inlangchain-ai/langchainplus, re-verified against currentorigin/mainafter the reviewer's feedback. Product behavior that is not visible in the code (indexing limits, legacy-view translation, rollout cohorts) comes from the reviewer's answers on DOC-1570.Two items where the code contradicted a review comment, both raised on the review threads:
attachments"only supports exists/not exists"["is", "is_not", "wildcard", "exists"], and nothing suppresses them. Page documents all four.Deliberately omitted
Needs careful review
metadatarow. Metadata accepts~per the schema but is indexed separately from the full-text token index, so the row leads withmetadata.<key>and describes~as searching metadata values. Confirm that phrasing is right.Follow-ups (not in this PR)
src/docs.jsonnav entry tolangsmith/filter-traces; the page is currently an orphan/langsmith/filter-traces-in-applicationredirect, which requires moving the ClickHouse page off that slug#filter-operatorsbecomes#operatorsinbilling.mdx:163,#create-and-apply-filtersbecomes#build-a-queryinengine.mdx:148andthreads.mdx:292, and two links to#example-filtering-for-tool-callshave no successorthreads.mdx:292names the Add filter button and Save viewengine.mdx:148refers to the "filter editor"rules.mdx:85says "Automation rule filters work the same way as filters applied to traces in the project", which becomes false for SmithDB users once this page is live, because rule filters keep the previous chip-based builderdashboards.mdxfor the same problem.dashboards.mdx:101describes chart filters as "one + Filter in the Filter & group panel", the previous builder, which will read as inconsistent beside this page#example-filtering-for-tool-calls, whichonline-evaluations-code.mdxandonline-evaluations-llm-as-judge.mdxboth link totrace-view-filter-light/dark.pngalt text, which describes the three view modes while the images show the old Filters field listfilter-bar-search-*andfilter-shortcut-pane-*images, which show the previous UIAI disclosure
Drafted by Claude Opus 5 via Claude Code. Source material: the DOC-1570 Linear issue and its attachments (demo walkthrough frames, transcript, UI screenshots), the filter revamp PRD and filter syntax spec, and the
langchain-ai/langchainplusimplementation. Product behavior in the page was checked against the implementation or against the reviewer's written answers; see "How the details were verified".